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(54) Method for motion estimated and compensated Reid Rate-Up-conversion (FRLI) for video 
aplllcations, and de^ce fbr actuating such method 



(57) A method and a device lor motion estimated 
and comp«isated ReW Rate Up-conversion (FRU) for 
video applications, providing for: a) dividing an image 
field to be interpolated into a plurality of image blocks 
(IB), each image block made up of a respective set of 
image elements of the image field to be interpolated: b) 
for each image t^ock (K(x,y)j of at least a sub-plurality 
(Q1 ,02) of said pIiA-ality of image blocks, considering a 
group of neighboring image t>iocks (NB[1]-NB[4]); c) 
determining an estimated motion vector for saki image 
biock (K(x.y)), describing the movement of said irage 
block (K(x«y)) from a previous image field to a following 
image field between which the image field to be interpo- 
lated is comprised, on the basis of predictor motion vec- 
tors (P[1]-P[4]) associated to said group of neighboring 
image blocks; d) determining each image element of 
sakl image block (K(x.y)) by interpolation of two corre- 
sponding image elements in said previous and following 
image fields related t>y said estimated motion vector. 
Step c) provides for: c1) applying to the image block 
(K(x,y)) each of said predictor motion vectors to deter- 
mine a respective pair of corresponding image blocks in 
said previous and following image fields, respectively; 
c2) for each of said pairs of corresponding image 
blocks, evaluating an enor function (err[0) which is tiie 
Sum of lumineu^ce Absolute Difference (SAD) between 
corresponding image elements in said pair of corre- 
sponding in^ge t)Iocks; c3) for each pair of said predic- 
tor motion vectors, evaluating a degree of homogeneity 
(H(i.d); c4) for each pair of said predictor motion vec- 
tors, applying a fuzzy rule having an activation level 
(r[k]) which is higher the higher the degree of homoge- 



neity of the pair of predictor motion vectors and the 
smaller the enor functions of the pair of predictor motion 
vectors; c5) determining an optimum fuzzy rule having 
the highest activation level (rfoptD. and determining the 
best predictor motion vector (P[min]) of the pair assod- 
ated to said optimum fuzzy rule having the smaller error 
function; c6) determining the estimated motion vector 
for said image block (K(x,y)) on the fc>asis of saki best 
predictor motion vector (P[min]). 
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The present invention relates to a methcxi for motion estimated and cpmpensateci Reld Rate U|><jbnversion (FRU) 
for video appiicaticxis, arKl to a device for actuating such metfiod. More particularly, the Invention relates to a metiiod 
5. based on the so-called "block-matching technique V 

. The market introduction of high-erid TV sets, based on 100 Hz Cathodic Ray TiA>es (CRTs), required the develop- 
ment of refiable Reld Rate Up-oohversion (FRU) techniques, to remove artifacts such as large area flicker ahdiine 
flicker. 

Methods fbr FRU are known (hereafter referred to as "standard FRU methods7 whk:rh interpolate the missing 
10 image fietels to be displ^ed on the CRT without perfomriing an estimation and cmpensation of rhotion of rnoifirig 
objects in successive image fiekis. 

This standard FRU methods are satisfeictory in improving the quality of an image and reducing artifacts such as 
large-area flicker or line flicker. However, when FRU is performed by means of the standard methods new artifacts can 
appear in the displayed image. In particular, if the image contains nioving objects like subtities. motion judder is intro- 
IS diiced. In fact, the interix>lation algorithm is not able to detect the objects' motion, and this can lead to interpolated fields 
wherein the moving objects are displayed in wrong positions. 

The protdem is t^etter urvierstood by referring to Rgure 1. wherein tfie motion trajectory of a moving object (white 
squares) in the original (i:e. transmitted and received) image fields is supposed to be a straight Una If the nnissing fields 
result from interpolation by means of a standard FRU nriethod (l.a whithout motion estimation and compensation), tiie . 
20 position of the moving object in the interpolated fiekis (dark gray squares) is not as expected by the observer (dotted 
squares). 

Such artifacts are visible and induce a blurring effect of fast moving otDjects, which can reduce considerably the 
quality of the displayed images. 

In order to avokJ such a k}lum*ng effect and to reduce artifacts, FRU metiiods have been proposed capable of per- 
25 forming a motion estimation and compensation of moving objects in the image fields. Substantially, motion estimation 
and compensation provides for detecting the moving parts of the received image fiekis and interpolating the missing 
fieWs according to the estimated motion. 

The movement of objects in consecutive image fields can be represented by so-called "motion vectors". 

Vyith reference to Rgure 2. let's consider an image containing moving objects. Between two consecutive recieived 
30 innage fiekfe, the nrx)ving ot^ects will have changed their position; for example, object MO which In the previous fieU 
(Fieki T) is in position A, in the current field (Reki T+1) is in position B. A motion exsts from the prevfous fieU to the 
current fieki, and this motion can k>e represented by a vector AB called motion vector. 

The motion vector AB represents the motion of object MO frorh position A in the previous field to position B in the 
current fieki: starting from position A in the previous field, applying to object MO the motion vector AB, tiie ot^ect MO is 
35 translated into position B in the cunrent fieki. The position I of tiie object MO in the nv'ssing fieki (Rekf T-i>1/2) that has 
to be interpolated, must be calculated by the interpolation of the previous field and the current fieki taking account of 
the respective positions A and B of the movir^ object MO. If object MO does not change position between the previous 
field and the current fieki. (I.e., if A and B are the same), position I in the missing field is obtained by the translation of 
A witii a motion vector |AB|/2. In this way, it is possible to avoid the blurring effect and the missing field is interpolated 
40 witii the moving object in tiie right position. 

Theoricaily, for each pixel of a fieki a corresponding nrK>tion vector couki be calculated. However this would enor- 
mously increase the number of calculations, and the memory requirements. In the practice, assuming that the dimen- 
sions of the objects in tiie image are always larger than tiiat of a pixel, the image fieki is divkied into inr^ge blocks IB 
(Figure 3), and the motion vector for each block is cafoulated. The dimension of the blocks in terms off pixels is generally 
45 chosen on an experimental basis. The position of a block in a field is identified by the coordinates of the first pixel 
(upper-left) of this block in this fieki. 

A further assumption which is normally made is that the movement of each block is rigki and translational only. 

The metiiod generically provides for detecting the nfx>ving blocks in two consequent image fiekis, and interpolating 
the missing fiekis according to the new positions of tiie blocks. 
so As shown in Figure 4, a matrix MV (Motion Vectors) is associated to the pattern of t>locks of an image field. This 
matrix MV contains the motion vector of each biodk of the pattern. To simplify the implementation of the algorithm, it is 
assumed that the motion vectors of matrix MV con-espond to tiie motion vectors of the bfocks of the missing fieki. To 
each block K(x,y) of the missing field, that has a pre-definite position x, y (where x and y are the coordinates of the 
upper-left pixel of the block), there con^esponds a motion vector. The position of the block in the missing fieki is at the 
55 rrudcfle between the position of a con-esponding t^lock B1 in the previous field and the position of a corresponding block 
B2 in the current field, blocks B1 and B2 being related by tiie motion vector Y in matrix MV. 

Sc€uining the matrix MV. tiianks to the position of the motion vector in the matrix and the value of tiiis motion vector, 
the position of the blocks B1 and B2 where we have to apply the motion in the prevfous and current field are easily avail- 



2 



EP0874523A1 

able.'- 

Considering a generic block K(x.^ in the missing field to be interpolated, where (x.y) are the coordinate identifying 
the position of block K, the correspondinig Vector in matrix MV is a vector V(dx,dy), and the corresponding blocks B1, 
B2 In the previous and current field will be at positions: 
5 prevk)usfield:B1(xKJx;y<iy):curremfiekJ:B2(x4dx;y4^^ (1) 

Thus, once the matrix MV of motion vectors has been built the motion of each block between consecutive image 
fields is delemiined. and the missing fields can be interpolated with the blocks in correct positions. 

To build up the matrix MV of motion vectors, the image blocks are scanned starting from the upper-left one down 
to the bottom-right one. According to the so-called "block-matching" technique, for each image block some neighboring 
iQ blocks are considered, together with their respcictive motion vectors; for those neighbouring blocks which precbeds the 
block under examinatbn in the scanning sequence of the image blocks, the already calculated motibn vectors are used: 
for those neighbouring blocks following the block under consideration in the scanning sequence, for which the new 
motion vectors has not yet been calculated, the motion vectors of the previously calculated and stored riiatrix MV are 
used. The motion vector associated to the bibck under consideration is then calculated on the basis of the motion vee- 
rs tors of the neighbouring blocks. ■ : 

The method involves a recursive algorithm, and the performance of the method, and thus the results of the dis- 
played image, depends on the choice of the naghbourings blocks and on the way in which the rriotion vector for the 
block is cateulated starting from the motion vectors of the neighbouring blocks. 

in view oHhe state of the art it is an object of the present invention to provide a method for motk)n estimated and 
20 compensated FRU. 

According to the present invention, such an object is achieved by means of a method for motion estimated and 
compensated field rate up-conversion providing for: 

a) dividing an image field to be interpolated into a plurality of image blocks, each image block made ip of a respec- 
25 five set of image elements of the image field to be interpolated; 

b) for each image block of at least a sut>^urality of said plurality of image blocks, considering a group of neighbor- 
ing image blocks; 

c) detennining an estimated motion vector for said image tiiock, describing the niovement of saki image block from 
a prevk)us image f ieM to a fdiowing image f ieki between which the image f iekJ to be interpolated ts comprised, on 

30 the basis of predictor miotton vectors assodated to sakJ group of nei 

d) determining each irrage element of said image block by interpolation of two corre^nding image elements in 
said previous and following image fields related by said estimated motion vector; characterized in that step c) pro- 
vkJesfor: 

35 c1) applying to the image block each of said predictor motion vector to determine a pair of corresponding 

image blocks in said previous and following image fields, respectively; 

c2) for each of said pairs of conesponding image blocks, evaluating an error function which is the Sum of lumi- 
nance Absolute Difference (SAD) between conresponding image elements in said pair of con^esponding image 
btocks; 

40 c3) for each pair of said predictor motion vectors, evaluating a degree of homogeneity; 

c4) for each pair of said predictor motion vectors, applying a fuzzy rule having an activation level which is 
higher the higher the degree of homogeneity of the pair of predictor motion vectors and the smaller the error 
functions of the pair of predictor motion vectors; 

c5) determining an optimum fuzzy rule having ttie highest activation level, and determining tiie best predictor 
45 motion vector of the pair associated to said optimum fuzzy rule having the smaller error function; 

c6) determining the estimated motion vector for said image block on tiie basis of said best predictor motion 
vector. 

Also according to the present invention, tiiere is provkied a device suitable for performing such a method, charac- 
so terized by comprising: 

-) image element storage means for storing image elements of the previous and following image fields for aeating 
a search area in the previous and following image f lekJs; 

-) addressing means for addressing selected image elements in said storage means; 
55 -) motion vector storage means for storing the estimated motion vectors; 

-) first computation means supplied liy said storage means for evaluating sakI error functions associated to said 
predictor motion vectors; 

-) a fuzzy computation unit supplied by said first computation means and said motion vector storage means for 
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determining said best predictor motion vector by applying said fuzzy rule to each pair of predictor motion vectors 
arvi to the values of the assodated error functions; . 

-) interpolation means supplied by said storage mears for determining each image element of said iniage Wock by 
interpolation of two corresponding image elements in said previous and^fpllowing imagieiieids related^by said esti- , 
5. ■ nriated motion vector. . .v.^,:- . 

The features and advantages of the present invention will be made, iapparent by the foiiowing detailed description . 
of a particular embpcpment thereof^ iDustrated by way of a non-limiting eparrjple in the annexed drawings, wherein: 

10 Figure 1 schematic^Hy shews the results of a stai^ 

Figure 2 schematically shovvs the change of position of a moving ctied between two consecutive received image . 
•-fields; \ v, ; - . ..... ' 

Rgure 3 schematicajiy shows ah image field divided in a pattern of image t)locks; 
Rgure 4 schematically shows the operation of a m^ 

IS Figure Sschematically shows two quincurixpattem of inriagel)locte of an irnage field; 

Rgure 6 schematically shows an image btock for which a motion vector is to be evaluated, and a pattern of neigh- 
tx>ring t^octeusk! to.perform the method of the inventim^ , . . ..t . j ^ 

Figure 7 schematically shows portions of two corresponding image blocte jn a prenbus and in a curent image . 
fields;..^, ^ ' ■' : ■ -v. .^ -.v 

20 Rgures to 1 1 depict membership functions used to perform a fuzzy calculation; 

Rgure 12 schematfoally shows a pattern of motion vectors used to interpolate a motipn vector; 
Rgures 13 and 14 schematically show a pattern of motion vectors used to implement an "erosion" process- 
Figure 1 5 schematically shows the interpolation of a pixel of a field to be interpolated; 

Figure 16 schematically shows an Interpolation process for determining missing pixels in the previous and current 
25 fields; 

Figure 1 7 is a schematic t^lock diagram of a device according to the invention; and 
F^ures 18 to 23 are schematic block diagrams of some blocks of the device of Rgure 17.^ 

As des^ibed in connection with Rgure 3. in order to keep the cateulation to be perfprrned to a reasonat>le number 

30 each image field is divided into image blocks IB of equal dimensfon. As previously inentioned, the dimension of each 
t)lock IB is determined on an experimental t>asis; a suitat)le dimension has proved to t>e 8x8 pixels' of the image frame 
(containing both the odd lines and ttie even lines), i.e. 4x8 pixels of the image field (containing either the odd or the even 
lines). With such dimension, the number of blocks per image f iekJ is (288/4)x(720/8)=72x90 blocks, where 288 is the 
number of lines and 720 is the number of columns of a field in standard interlaced scanning. 

35 Preferably, in order to furttier reduce tiie number of calculations and the required memory resources, instead of 
evaluating the motion vectors for ail the blocks of the image field, only the tMocks belonging to ^ther one or the other of 
the two so-called **qulncunx sut>-sampling patterns" Q1 . Q2 shown in Rgure 5 are considered. The division of the field 
into two quincunx patterns enables to divide the rate of calculation nearly by two. However, it is evident that this is not 
to be intended as a limitation, because it could be possible to consider all the blocks of the field. 

40 As shown in Figure 6, for each generic bfock K(x,y) of tiie Chosen quincunx pattern, four neighboring tslocks NB[P]- 
NB[3] are considered, together with their assodated motion vectors P[0]-P[3] ("predictor motion vectors"). Experimen- 
tally, it has t>een verified that the best choice involves the nearest t>iocks in the two diagonal directions; this choice is 
also compatible with the quincunx sut>*sampiing of the t)locks in the image field. For the two t>locks NB[0], NB[1] pre- 
ceding block K(x,y) in the image block scanning sequence, the values of motion vectors P[0] and P[1] have already 

45 been catoulated and are available in the cun-ent motion vector matrix, while for the blocks NB[2], NB[3] following t)lock 
K(x,y) the values of motion vectors P[2] and Pp] are extracted from tfie previous motion vector matrix, which has been 
previously calculated and stored. 

Each one of the four motion vectors P[0]-P[3] is then applied to block K(x,y). In this way. for each motion vector P[1]- 
P[3] two conresponding blocks, respectively in tiie current field and in tiie previous f ieki, are determined, according to 

50 equations (1) atx>ve. Four pairs of blocks are thus determined. 

In order to determine which one of the motion vectors P[i] ft e [0;3]) has the best direction for the block K(x.y) under 
examination, for each pair of corresponding blocks obtained in the previous and current fields, an error function en'p] is 
calculated. The error function enfO is the is tiie Sum of the luminance Absolute Difference (SAD), pixel to pixel, between 
the two corresponding blocks in tiie previous and current fields: 

55 
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errlil^SADpcXPpD^y- 

« 5^ llumpc + x,.Y + y, t -1)rliJ^ . 

xep;71 

5 y«P;7] 

where: X,Y are the coordinates of the upper-left pixel off the t)lock found in the previous field; lumQ^^Q is the lunrii- - 
nance of the pixel at position O&y) in the cunrent field (previous field if instead of t is M); P[i] is the motion vector of coor- 
dinates (dx. dy). 

10 In this way, four error values en[i] are obtained, one for each predictor motion: vector PQ. . 

The components of the generic precictor motion vector P[g atong the ooordnate axes x, y are called P[i]x and P[i]y, 
respectively. 

Since each image field contains either the odd or the even lilies of animage frame (interiaced transmission stand- 
ard), the conresponding blocks in the previous and current fields do not contain all the image lines: if for exarnple the 
IS previous field is an odd field and the current field is an even field, the block in the previous field contains only the odd 
lines, while the corresponding block in the current field contains only the even lines. To compute the error function errO] 
for any value of the motion vector it is necessary to have, in the corresponding blocks in the previous and current f ietefs^ 
both the odd and the even lines. 

The algorfthm interpolates the missing lines of the blocks necessary for the confutation of the enror function en^i] 
20 depending on the parity of the first line of each btock Assuming that the y-component of the motion vectors is always 
even, then the first pixel of a block in the previous field and the first pixel of the corresponding btock in the current field 
will belong to image lines with the same line parity. 

Refening to Figure 7. where only one case is drawn, the other being obviously symmetrical, in each image block it 
is necessary to interpolate one line over two. To perform the interpolation, a median filter is advantageously used: the 
25 pixels belonging to the missing lines of the block are therefore given by: 
Px3 = MED(Px1,Px2.Px4) 

When the pixel to be interpolated is on the first or the last line of the block, like the jpiixB\ Px6 in Rgure 7, the pixel 
just before can be used (if it is possible, otheiwise it is possible to use line repetitfon) to manage this interpolation, and 
the result is: 
30 Px6 = MED(Px4.Px5.Px1). 

It should be noted that this interpolation depends on the motion vector: in fact, the value of the missing pixel Px3 of 
the block in the previous f iekl is interpolated using the value of the available pixel Px4 of the corresponding block in the 
cunrent field, obtanied by applying the motion vector P[i]. In this way the quality of the interpolation is greatly improved. 

So. for each predictor motion vector P[r], two con*esponding blocks In the previous and current field are determined, 
35 the missing lines of each of the two con-esponding blocks are interpolated, and then the corresponding en-or function 
errp] is evaluated. 

To see which one of the four predictor motion vectors P[Q fits best the motion of block K(x.y) between the previous 
and the current field. tx>th the value of the enror functions err[i] and a "degree of homogeneity" t>etween each pair of 
different predictor motion vectors P[i] and PQ] (ij e [0;3] and i^sj). is analyzed. To do this, according to the Invention, a 
40 fuzzy computation is performed applying tiie following fuzzy rule to each pair of predictor motion vectors Pp], Pfl]: 

"If the vectors P[i] and PDJ are homogeneous and errp] is small and errO] is small then this function is liigh' ; 
six different paira of predictor motion vectors exist, so a total of six fuzzy rules are to be eval^^ 
To test the degree of homogeneity between two different predictor motion vectors, tiie following homogeneity value 
H(i.j) is first computed: 
45 HO.D = |Plilx-PDJx| + |P[i]y-P[Dy|. 

Then a memt)ership function, such as the one depicted in Rgure 8. is applied to the homogeneity value H(i,j) to 
obtain a fuzzy variable h(i,j). whose value indicates the degree of membership of the value of H(i,j) to the fuzzy set 
"homogeneous". In Figure 8, Hi can be a value preferably comprised between 7 and 14. 

Similariy. a membership function such as the one depicted in Rgure 9 is applied to the value of the error functions 
so err[i] to obtain a fuzzy variable e(i) whose value is indicative of the degree of membership of the value of errp] to the 
fuzzy set "smair. In Rgure 9. err1 is a value preferably comprised between 40 and 70, and err2 is a value preferably 
comprised between 1 80 and 200. 

Each one of the six fuzzy rules provides a value (activation level of the fuzzy rule) rp^ (k e P:5D, which is: 
rM = min(h(ij').e(0.eG)). 
55 Additionally, a further (seventh) fuzzy rule is evaluated: 

"If all the errp] values are high and P[0J and P[1] are high then this functbn is high" . 
First the following values are computed: 
UP(x) = |P[0]x + P[1]x| ; UP(y) = |P[0]y + PI1]y| 
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Then a membership funcb'on such as the one depicted in Figure 10 s appfied to each of the values of UP(x} and 
UP(y) to obtain two fuzzy variables up(x) arid ip{y) Micathfe of the degree of menibership of values UP(x) and UP(y) 
to a first fuzzy set "liigh". In Figure 10, UP1 Is a value preferably comprised betiween 4 and 9, and UP2 Is a value pref<= . 
erably comprised between 12 and 20. 
5 Finally, a membership function such as the one depicted in Rgure 1 1 is applied to the values of the error functions 
errO] to ot>tain a fuzzy variat)le e*(i) whose value is indicative of the degree of membership of the values of err[i] to a 
secoTKl fuzzy set "high". In Figure 11, err3 is a value preferably comprised. between 280 and 320, and err4. is a value 
preferablycomprised between 380 and 420. . 

The value (activation leveO rI6] of the severith fuzzy rule is given by: .n . 

10 rt61 = min{e'(0).ememer(3);up{x),up(y» . . 

The meaning of the values r[ki (k e [0;51) ard r[q is now discussed. 

For each ke [0;5}, the smaller the values of the pair of error functions err[i], errQ] assodated to the pair of predictor 
motion vectors P[i], PD], ari4 the smaller the difference between the two respective motion vectors P[i], PQ the higher 
r[k]: in other.words, the activatiori.level rO^ of the con^esponding fuzzy rule depends on the sum of absolute luminance 

IS difference (SAD) off the pixels of the corresponding blocks in the previous and current field, but also on the degree of 
homogeneity of the motion vectors; f : , 

As regards r[6]. tine higher the values of the four error functions err[q associated to the four predictor motion vectors 
and the greater the predictor motion vectors P[0] and P[1], the higher r[^. The seventh fuzzy rule t^s an activatk>n level 
r[6] which is higher, the more the situation is uncertain, {.e^^^ when there is a large movement (P[0] and P[1] high), but 

20 none of the iour predictor motion vectors seem to provide a good result in terms of error function when epplied to the 
block K(x.y). 

The pair of predictor motion vectors P[i] and PQ] for which the function r[k] (k e- [0;5]) has the highest value (i.e. the 
pair of motion vectors for which tiie corresponding fuzzy rule has the highest activation le\^el among the first six fuzzy 
rules) is chosen; let*s r[opg denote tiie highest value among r[0]-rt5|. Among tiie two predictor vectors P[i] and PQ assq^ 
25 c^ed to said fuzzy rule, the one for which the value of tiie conresponding error hinction err[i], errQ Is ntinimum is called 
P[min]. 

A-candidate motion vector C is then calculated according to the following algorittim: 

: if r[opt] +.r[6] ^ Rth. where Rih is a prescribed activation level threshoM, tiien tiie candklate motion vector C has 
. the following components: 



30 
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P[ntin] ^ X r[opq 
^""^ rtopt] + rt61 

P[min] y X r[opt] 



r[opl] + rI6] 



Thus, the components Cx arxJ Cy of vector C are respectively equal to P[min]x and P[min]^ multipled by a weighting 
fector that depends on the respective activation levels of the most activated one of the first six fuzzy rules (r[opt]) and 
40 of the seventh fuzzy rule (r[6]). It follows that in a situation of uncertainty as to tiie choice of the blest motion vector, the 
vector 0 is preferred. Thanks to these weighted components,' the value of C depends on tiie characteristics of the dif- 
ferent vectors. This means that the components are determined according to both tiie homogeneity of the predictor 
motion vectors and the error between the pairs of con-esponding tHocks obtained by means of the four predictor motion 
vectors. 

4S If instead r[opq + r[6] < Rtn, that is if none of tiie fuzzy rules is suff icientiy activated, then carKfidate vector C is niade 
equal to the predictor motion vector P[i] for which the error function err[i] is the smallest. This means that if the errors 
err[i] are too high, if the vectors are not homogeneous, than the predictor motion vector with the minimum error value is 
directiy chosen as cand'date motion vector for block K(x.y), because tiie weighting of its components is not reliable. 
A suitable value for R^, has experimentally been determined to be 0.1 . 
so Vector C thus calculated is the candidate motion vector for ttie block K(x.y) under examination. This vector could 
t>e stored in the motion vector matrix MV in the position corresporxiing to block K(x,y). 

However, in order to improve the estimation of motion of block K(x,y). srtiall perturt)ations f updates") are applied 
to the candidate motion vector C to obtain updated rTK>tion vectors; each updated motion vector individuates two corre- 
- sponding blocks in the previous and cun-ent fields; the error functions associated to the updated motion vectors are cal- 
5S culated in the way same previously explained in connection with predictor motion vectors P[Q. 
The updates applied to candidate motion vector C are tiie following: 

f irstiy. tiie fdfowing set of four updates is always applied to tiie components Gx and Cy of vector C: 
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rli rfh r-li rOi 



Four updated vectors Vli[1]'Vi4^] are obtained* arid for each one of these the oonresponding error function err is . f 

evaluated, in the sanie way previously descnlDed in connection wi^ f 

Then, depending on the t^lock K(x,y) urxier examination, one or the other of the following set of four updates are f 
attenriatiyely applied to the cancfidate motion vector C: 



Wx = Med(^^^^^^^. V3x. V4x) 



Wy « Med( ^^y^^^ , V3y, V4y) 



In this way. the motion vector matrix MV can be completed. For every image block, a corresponding motion vector 
is provided in the matrix, either estimated by means of the previously described algorithm or interpolated. 

The motion vector matrix can be used to interpolsrte the missing image field tatdng into account the movement of 
the image blocks according to the algorithm which will be descrft)ed later on. 
55 However, in order to maximize the uniformity of the rnotion vector field, the following **erosion" process of the motion 
vector field (i.e., all the motion vectors of the matrix MV) is performed before actually interpolating the missing field. 

Inside the motion vector matrix, patterns of vectors like the one shown in Figure 13 are considered. 

Considering a vector E In the center of such a pattern, the corresponding image block is divided in four equal sut>- 



•5 



Again, four updated vectors Vu[5]-VU[8] are obtained, and for each one t^^ | 

IS uated. | 

As visible, eadi update rnodrfiesorily one of the cornponentsCx and Cy of vector i 

In this way there are obtained, for each block, eight new error function values, each one oonresponding to a respec- | 

tive updated vector VUI1]-VU[8]. - t. 

A penalt]^value is then added to the error function values for the updated vectors, the value of the penalty depend- | 

20 ing on the value of the update. . f 

To this purpose, the components of vector C Cx and Cy are examined. If the update is added to th0 component of ' k 

C of greater value, then a first penalty value PEN1 is added to the error function value asi^ | 

if the update is added to the component of C of smaller value, a second penalty value PEN2 is added to the error tunc- li 
tion value associated to such updated vector, with PEN2>PEN1 . Experimentally it has been found that suitable values 

25 for PEN1 and PEN2 are respectively 76 and 228. In this way. the ujxjated vectors which have a direction more different 1 

from the direction of vector C are somehow penalized in the choice to be made. t 

The error functions for the updated vectors, added with the respective penalty value, form a set of eight errors func- I 
tions related to eight motion. vectors. The updated motion vector providing the smallest error function value is chosen 
as the motion vector of the bfock K(x,y) under consideration. Again, to this motion vector will conrespond one block in 

30 the previous fiekl and one in the currernfieM, determined according to equations (1) above ! 
Up to now, the way in which the motion vector for a generic image t)lock is estimated has been descnlDed. If all the 
image blocks of the missing image field to be interpolated were submitted to this calculation, a motion vector matrix MV 
win be straightfonwardly built However, since as previously mentioned a suitable way for reducing the numt>er of cafou- 
lations consists in estimating the motion vectors of only a subset of the image blocks of a fiefo, namely those blocks 
35 belonging to either one or the other of the two quincunx patterns Q1.Q2 depicted in Rgure 5. motion vectors for only a 

half of the image blocks are actually estimated according to the algorithm previously described. The motion vectors of i 

the remaining image blocks are to be interpolated. For tiie interpolation, median filters are used. I 

Witfi reference to Figure 1 2, representing a portion of the motion vector matrix M V, the white squares represent the f 

nrKTtion vectors computed tiy means of the previously described algorithm, while the shaded blocks represent the :t 

40 votiGon vectors to be interpolated. If the motion vector W is to be interpolated, tiie four nearest motion vectors V1 -V4 |; 

which have been estimated by means of the previously described algorittvn are considered. The corrponents Wx and I: 

Wy of vector Ware interpolated in the following way: . |> 
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blocks (Figure 14); fix each sid>-block9f said block, a respective motion vector {E.i,4,i..i..E^i,.i}.is determined accord- 
ing to a median filtering performed with velctor E and the nearest neighboring vectors {Va, Vt^ Vc, Vd}. as to have the best 
matching vector possible. In this way. a new ("eroded**) vector matrix having four times moire elements is obtained. The , 
lour sut>-vectors {E.i .,.^....,E^-{ _i} are determined as shown in the f^^^ 



10 



15 



Sut>-block 


Vector 


E-1.+1 


MED(Va.VcE) 


E+1,41 


MED(VSa,Vd.E) 




MED(Vb,Vc.E) 




MEp(Vb,Vd.E) 



20 



30 



35 



The new motion vector matrix, having four times mo'e elements than the starting one. contains motion vectors 
which fits well to the motion of the pictura 

Applying the mojton vectors oil tiie matrix to the different blocks of the missing field, the conresponding blocks, in tiie 
pranous and current f ieki can be determined. To each pixel of the current field there corresponds a motion vector that 
joins the pixel of the current field to a conresponding pixel of the previous field. 

As already mentioned, the previous and current fields only contain a half of the lines of an inrage frame; for exam- 
ple, the previous field contains the ockJ lines and the current field contains the even lines. The missing lines of each f ieki 
can be. interpolated in a way similar to that used to iriterpolate the missing pixels of the k)tocks in performing the evalu- 
ation of, the error functions, on the tresis of the motion vectors. The two fields are thus transformed into iiK-ogressive 
fiekis. containg all the lines of an image frame. 

To interpolate the pixels of the missing field the following procedure is used. 

Refemng to Figure^ 1 5, to each pixel PXi of the missing f ieki to be interpolated (Rekl T+1/2 in the figure), a motion 
vector is assigned checking the image block (more predsety. the sub43locl4 to which the pixel PXi belongs. This motion 
vector indivkiuates two corresportding pixete belonging to the previous and to the current field, indicated as PXa and 
PXb. respectively. 

The value of pixel PXi can be determined on the t>asis of the average value of PXa and PXb. namely: 
PXi=(PXa+PXb)y2 . 

Better results are obtained if tilie following interpolation method is followed. In Figure 15, the pixels indrvkiuated in 
the prevknjs and current fieM by the zero motion vector crossing the position of pixel PXi are PXao and PXbo. The value 
of pixel PXi is deternrtined by perfbrrning the following median filteri 



40 



PXi = MED(- 



PXan + PXbr 



2.PXa.PXb) 



45 



SO 



Lefs conskier the order the fields are received, and how the original fiekis and the interpolated ones are output. 
Reld-Rate Upoonversion (FRU) provkies for outputting two times more fields than the original fieki-rata The order is 
the following: 

input f ieW sequence: Oq. Eq. 

output field sequence: Oq. Eioo. Oigoi EIeo Oi,... 
where: 

Oq: original odd field containing odd image lines; 
Eq! original even field containing even image lines; 

Oi^o- irtterpolated odd field containing the odd interpolated lines of the original even f ieki at the time of Eq; 
Eioo* interpolated even f ieki containing the even interpolated lines t>etween Oq and Eq; 
EIeq: interpolated even fieki containing tiie even interpolated lines between Eq and Oi. 



55 The original odd fiekis are output without any changa Fiekis Eioo and Ei^o are interpolated according to the algo- 
rithm previously described, taking into account the motion of objects between fiekis Oq and Eq. and Eq and , respec- 
tively. 

To interpolate the fieki OIeo tiie motion vector fieki calculated to estimate motion between fields Oq and Eq is 
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already available, so that the pixels PX of the odd Ones missing in field Eq are computed by the threeix>irrt median fD* 
tering among the pixels PX1 , PX2 and PX3. where PX1 and PX2 are the available pixels of the current field Eq sur- 
rounding the missing pixel PX. and PX3 is the pixel of the previous field Go pointed the motion vector associated to 
pixel PX{Rgure 16). 

5 Up to new motion of objects between two adiacent fields has been assumed to be present This is the case when' 
the image field sequence originates from a television camera (camera mode). 

But when the image field sequence is originated from a movie, motion betwe^ two adiacents fields will take place 
only once over a couple of image frames. This is due to the particular procedure followed to transmit the movie material. ' 
Typically, a movie contains 24 pictures per second. For television broadcasting, the 24 pictures per second are con- 

10 verted into 25 image frames per second. In interlaced scanning, each image frame contains two interlaced image fields; 
so. each movie picture is converted into two image fields. Obviously, when two fields originate from the same movie pic- 
ture, no motion exists between the two fields. Motion only exists between fields originating from different movie pictures. 
i.e. once over a couple of image frames. 

Since the previously described interpolation algorithm is recursive, arid when no nxrtion exists between two con- 

IS secutive fields the motbn vector matrix only contains zero vectors, problems exist when at the next field (belonging to 
the next movie picture) nnotion is to be estirrated, because the information of motion estimated two fields in advance 
has got lost Thus, it is necessary to perform the interpolation of the missing fields according to tiie type of transmitted 
material. 

To selecf the proper motion estimation behavior and the proper sequence of the interpolated field a fOmHmode 
20 detector is needed. 

The proposed solution is t>ased on accumulating (i e.. summing) the motiori vectors of each vector nriatrix, and com- 
paring the accumulated values between two adjacents fields. 

Assuming that Ap and Ac are the accumulated motion vectors relating to the previous and current field, respec- 
tively, the normal camera mode is obtained whether the ratio between Ac and Ap (Ac/Ap) is approximately equal to 1, 
25 or it has the same trend (always inaeasing or always deaeasing) when two adiacent 

A register R is used to store propers values related to the Ac/Ap ratio, namely: 

R=0 if 1-Th ^ lAc/Apl ^ 1+Th: 
R=1 iflAc^Ap|>1+Th; 

30 R=2iflAc/Ap|<1-Th. . 

where Th is a proper threshold value. 
To distinguish between camera nrKxJe and film mode, the following rules are used: 

35 1) If [1-Th ^ |Ac/Ap| ^ 1+TTi] and [R = 0] then camera_mode. 

2) If [|(Ac/Ap| < 1-Th] and [R = 1] and current Jield_parity = even] then fi!m_mode(phase_0); 

3) If [|Ac/Ap| > 1 +Th] and [R = 2] and [cun'entjield.parity = odd] then f flm_mode(phase_0); 

4) IfQAc/Apl > 1 +ThJ and [R = 2] and [cunrentjield_pari^ = even] then film_mode(phase_1); 

5) If [|Ac/Ap| < 1-Th] and [R = 1] and [currentjieldjjarity = odd] then fBm_mode(phase__l); 
40 6) else camera_mode. 

Cunrent field parity is to be considered, because the change between two movie pictures can occur either between 
a next odd and a previous even field, or between a next even and a previous odd field, i.e. two different film ptmses 
(f ilm_mode(phase_0) and f ilm_mode(phase-1)) exist 
45 If camera mode is detected, the previously described interpolation algorithm is performed. 

if differently film mode is detected, tiie method provides for outputting the following field sequence (supposing that 
motion exists between the even field of an image frame and the odd field of the following frame): 

irputfield sequence: Oq. Eq, Ot,... 
so output field sequence: Oq. Eq, Oi^o* ^^eo - 
where: 

Oq: original odd field (odd image lines); 

Eq: original even field (even image lines, no motion with respect to Oq); 
Oi : original odd field (odd image lines, following image frame, motion with respect to Eq); 
55 OIeo' interpolated odd field (odd image lines, compensation of motion between Eq and Oi); 

Ei^o: interpolated even field (even image lines, compensation of motion between Eq and O^- 

A block diagram of a device suitable for implementing the motion estimated and compensated FRU previously 
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described is depicted in Fig. 1 7. _ ' 

In the drawing, PF aind CF indicate the streams of pixels of the previous and cun-ent Image fields, respectively, as 
received and stored in respec^e field memories (hot shown). 

PF and CF are respectively supplied to buffer units BUF1 and BUF2, suitakde to aeate, according to the titock- 
5 matching technique, portions f searchareasT of the previous and 

The outputs PFB, CFB of BUF1 and BUF2, determined by an address general 
addresses for addressing the pixels stored in blocks BUF1 and BUF2. supply a block SAD1 whtoh for each generic 
block K(x,y) (Rg. 6) performs the evaluation of the four enor functions en-p] (i g [0;3D associated to the four initially cho-: . 
sen predictor motion vectors POJ of the four neighboring blocks NBR); PFB and CFB also supply another block SAD2, . . 
10 . perfomoing the evaluation of the eight error functions err associated to the set of eight updated vectors ^^[1^Vll[8]; cal- 
culated block CBUILD. 

Due to the spatial and temporal recursive approach of the previously descrft>ed algorithm, a storage unit VMEM is 
required to store ttie already estimated motion vectors, both belonging to tiie current and the previous vector matrix 
. Blocks SAD1 and VMEM supply a block FUZZY which implements the fuzzy calculation previously described, and 
IS determiries tiiecbriponents of the cardidate motion vector C. 

The output of block FUZZY (i.e.. the candklate niotion vector C) supplies block CBUILD wfhich applies to the com- 
ponents of vector C tiie previously descrtoed sets of updates, to detemiine the eight updated motion vectors VUII]- 
Vu[8]. 

Block ADDGEN^etermines the proper image blocks pointed by ttie selected motion vector; block ADDQEN is sup- 

^ plied by the output of blpd< VPK>C and the output of block CBUI^^^ 

The values d tiie enror functions assodated to the eight updated motion vectors VUn^^^ 
SAD2, are supplied to block CSEL, which, according to tiie algorithm previously described, selects among tfie eight I 
updated vectors Vu[1 1-VU[8] the motion vector (having ttie smallest associated en^or function) to be associated to ti^e J 
cun^em image blod<K(x.y)as.estimated motion vector; tNs vector is tiien stored in tiie V . ] 

25 block VPRCX} is provkled to evaluate Oe., interpolate) tiie motion vectors for the image blocks not belonging to tiie cho- 
sen quincunx pattem. for which the fuzzy computation fe not performed. 

Also, block CSEL supplies a block FMDET, which is able to discriminate between camera mode and film mode 
according to the algorithm previously described. A control unit Cl^ is also provided which, in response to the result of . i 

tiie evaluation performed liy block FMDET. controls tiie blocks VMEM and VPROC. Control unit CNT generates two 

30 control signals EN and ENW, respectively supplied to blocks VPROC and VMEM Signal EN is activated when block I 
VPROC has to interpolate a motion yector not belonging to tiie chosen quincunx pattem, Ixit is disactivated during the 
motion estimation phase; signal ENW is activated to store the motion vector at tiie output of block CSEL into block 
VMEM. 

At tiie end an interpolator block INT. supplied by the outputs PFB and CFB of BUF1 and BUF2, is provided to inter- ^ 
35 polate the pixels of the ntissing field according to tiie estinriated motion vectors; the e^ 

put of block VPROC, is supplied to block ADDGEN to determine the addresses of tiie con-esponding pixels in tiie 
previous and current fields related by the estimated motion vector. The interpolator block INT then performs the inter- 
polation of tiie missing pixel according to tiie median filtering previously descrbed. 

In the following the architecture of the main blocks of tiie device will be described. 
40 Blocks BUF1 and BUF2 have ttie same structure depicted in Figure 18. The purpose of these two blocks is to store 

part of the image pixels of the previous and cun^ent fields in order to implement a search area in both the previous and f 
the cun'ent image fields. The search area dimension is larger than the k)locks among which the match is computed and J: 
its dimension determines how big is the maximum motion vector that can be estimated. 

Basically, each block BUF1 , BUF2 is composed by a plurality of line mempries LM which store ttie image lines of 
45 ttie search area, and pixel delays PD. 

The number of line memories LM affects tiie maximum vertical component of the motion vector that can be esti- 
mated; the number of pixel delays PD affects the maximum horizontal component of said motion vector. 

Figure 19 shows one of four identical units composing block SAD 1 . 

For each generic block K(x,y) for which the respective motion vector is to be evaluated, block SAD1 evaluates tiie | 
50 four enor functfons err[0 associated to the four predictor riiotion vectors P[i]. Each vector P[i] individuates two con-e- - 
sponcCng image blocks in the previous and current fields, respectively In order to evaluate tiie matching degree of tiie 
two blocks pointed by ttie motion vector P[i], tiie associated error function err[i] is to be evaluated. Also, it has to be 
remembered that tiie corresponding image blocks in the prevfous and current fields have to be transformed into pro- 
gressive format to include all the image lines. 
55 This is done by blocks MF1 and MF2. which perform a median filtering to interpolate the missing pixels in each 
block (according to tiie algorithm previously described in connection witii Rgure 7). In the drawing: 

CF_CL: current field, cunrent line; 
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f 



CF_PL: current field, previous line; ^ 5. 

PF_CL: previous field, current line; ^ | 

PF_PL: previous field, preirious line. ' | 

5 The outputs of the median filters; together with PFjCL or. respectively, CF_CL are ^ppGed to a respective subtrac- - | 
torblpckSUB1.SUB2. vvhich performs the absolute difference of the lun^ | 
blocte; the outputs of the tvvosubtractors are then stored in an accumulator blo^ I 
To better urxierstand the architecture of tiiock SAD1, let us suppose an image block, once transformed into pro- . : | 
gressive format, has a dimension of 8*8 » 64 pixels. This means that in order to transform the block into progressive | 

70 format 32 out of the 64 pixels nrHist be imerpolated for each image block Thii^ | 
two corresponding image blocks in the previous and current fields. 64 median filters and 64 subtracters are needed. • I 
The accumulator block ACC provides the cumulative error errpj. Since block SAD1 has to calculate the error functions . 1 
err[i] related to the four predictor motion vectors P[i]. it has to contain four units equal to that shown in Rg. 19. . | 

The inner architecture of block FUZZY is shown in Figure 20. Depending on considerations based on the uniformity | 

IS of the four predictor motion vectors Pp] and on the associated enx>r functions err[i], a fuzzy process will create the cari^ 

didate motion vector C. | 
The Fuzzy Process basically consists of two parts: the first one is formed by blocks Ml. M2 and RCi and imple- | 
ments an inference (the first six fuzzy rules previously descnbed) based on the decree of homogeneity and on the | 
respective enor functions errp] of the four predictor vectors P[i] in oider to select the best predictor vector among the | 

20 previous four (P[rnin]): the second one is formed by blocks . | 

rule (the seventh fuzzy rule previously described) when all the predictor vectors Pp] have high erroriunctions errp] and | 
extents, so that the zero vector is in this case selected. | 
More particularly, block Ml implements the mend^ership function shown In Figure 8 (on the basis of the values H(i,j) ;| 
calculated by homogeneity e^luator block HE). M2 implements the membership functio t 

25 RC1 evaluates the activation levels rp^ (k = 0-5) of the first six fuzzy rules previously desaibed; the output of block RCI . f 
is therefore formed by the six activation levels r[k]. Block M3 implements the membership function depicted if Rgure 11. . i 

M4 inplements the membership functions deleted in Rgure 1 0 (one for tiie two components UP(x), UP(y). calculated . 
by extent evaluator block EE), and block RC2 evaluates the activation level r[6] of tiie seventh fuzzy rule; the output of 
block RC2 is therefore formed k>y the activation level r[6]. 

30 The four predictor vectors Pp] are provkied to block FUZZY by block VMEM; tiie values of tiie four error functions >' 
errp] are provided by block SAD1 . 

The output r\k] (k^O-5) of block RCI is supplied to a block RS (Rule Selector) which selects tiie one among the f irst 
six fuzzy rules having the highest activation level (r[opt]). As previously described, two of the four predictor vectors Pp]. . 
P[fl are associated to each one of tiie first six fuzzy rules. Once tiie fuzzy rule with tiie highest activation level r(opt] has . 

35 been determined, tiie predictor vector having tfie minimum error function between the two predictors lassociated to such 
a fuzzy rule is selected by block VS (Vector Selector). This vector P[mln] ("best predictor^ is supplied, togettier witii tiie 
value rlopf] provided by t^lock RS and tiie value r[6] provided by block RC2, to a block RC (Rule Compositfon) which 
cak:ulates tiie components Cx, Cy of tiie candidate motion vector C according to tiie formula previously descn*bed; bkx:k 
RC is also supplied by tiie values enrp] and by the four predictor vectors P[i], because as previously described when 

40 none of the seven fuzzy rules has a suffidentiy high activation level, the predictor vector having tiie smallest error func- i 
tion is chosen as vector C. | 
The structure of block CBUILD is depicted in Figure 21 . This block is supplied by vector C, and detemiines ttie eight | 
i^xiated vectors VU[1]-NAj[8]. | 
Stock SP splits vector C into its components Cx. along the X and Y axes. Block HU provkles tiie horizontal com- 

45 ponents of ttie sets of updates, which are added to Cx; similarly, block VU provides ttie vertical components of the sets 
of updates, which are added to Cy Block MC merges the horizontal and vertical components \/u[n]x. VU[n]y (n=1-8) of 
the updated vectors. The inner structure of blocks SP and MC depends on the particular data structure used to repre- 
sent the motion vectors. 

The eight updated vectors Vu[1]-Vii[8] are supplied to block SAD2. whk^h is composed of eight urots identical to that | 
so shown in Rgure 19. ^ 

Block CSEL adds to the eight error functions calculated by block SAD2 tiie conect penalty values PEN1 . PEN2. 
Then Block CSEL cortipares the eight error function values with added penalties, to determine the minimum error func- 
tion value and the associated vector, which can be one of the eight updated vectors VU[n]. The vector with the minimum 
enror function value is selected as estimated motion vector for the block K(x.y) under examinatton. 
55 Basically block CSEL is composed by adders (to add the penalty to tiie error functions associated to tiie eight 
updated vectors, calculated by block SAD2) and block suitable of evaluating ttie minimum among eight elements. 

The structure of block VPROC is shown if Rgure 22. As previously stated, tiie motion vector field is preferably esti- 
mated for a quincunx sub-sampled pattern of blocks. The missing motion vectors have to be interpolated. Block VPROC 
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a}mprtses a block VINT performing th^ 

missing motion vectors. Block VPROC also comprises a block VER performing the 'erosion" process previously 
described in connection with Rgures 13 and 14. Block VINT is supplied by the output of block VMEM; the output of 
block VER supplies a multiplexer block MUX which is also supplied directly by the output of block VMEM. Control signal 
5 EN provided by block CNT selects the behavior of Uock VP ROC, wNch must be active during the interpolation of the 
output vector field and net during the nxition estimation phase. 
Block FMDET has the structure shown in Rgure 23. 

The input V of block FMDET represents the currently estimated nrration vector, provkJed at the output of block 
CSEL; this vector is accumulated by block VACC with the other motion vectors previously estinrtated and relating to the 
10 same image field; at the output of block VACC the value Ac is obtained. FF Isa 100 Hz dock signal conresponding to 
the output field frequency, and supplies a register DELAY used to store the cumulated motion vector field relating tothe 
a field, and to output said cumulated value at the time of tiie following fleki; tiie output of register DELAY is Ap. 

A divider block DIV computes the ratio |Ac/Ap|. while a comparator btock CMP detenrrines wich condition is satis- 
fied (i.e|Ac/Ap|- 1. w |Ac/Ap| >1+Th, |Ac/Ap| < 1-Th). The result of this comparison is stored in a register R. A block 
IS. LG implements the boolean rules 1) to 5) previously descrtoed.; 

The output MODE (MODE=camera_nxxJe, 
MODE=fflm_mode(phase0), MODE=f ilm_nrK)de(phase 1)) of block LG is supplied to block CNT so that the proper con- 
trol signals EN, ENW can be generated only when required, i.e. or]dy when motion estimated and conpensated fiekl 
interpolation is to b&iperformed. 
20 Block INT implements tiie required cdriputation to interpolate the pixels of the missing field. Basically, it is com- 
posed by arKi adder and a median filter. 

Other metiiods can be used in order to exploit tiie motion Information. This is not restrictive for the purpose of the 
invention. 

25 Claims 



1 . Method for motion estimated and compensated Reld Rate Up-conversion (FRU) for video applications, providing 
for 

30 a) dividing an image field to be interpolated into a plurality of image blocks (IB), each image block made up of 

a respective set of Image elements of the image field to be interpolated; 

b) for each image block {K(x.y)) of at least a sub-plurality (Q1 .02) of said plurality of image blocks, considering 
a group of neighboring Image blocks (NB[0]-NBt3D: 

c) detemtining an estimated motion vector for said image block (K(x,y)), desaibing the movement of saki 
35 image block (K(x.y)) from a previous image field to a following image field between which the image field to be 

interpolated is comprised, on the basis of predictor motion vectors (P[0hP(3D associated to said ^oup of 
neightx>ring image blocks; 

d) determining each image element of said image block (K(x.y)) by interpolation of two corresponding image 
elements in said previous and following image fields related by said estimated motion vector; characterized in 

40 that step c) provides for: 

c1) applying to the image block (K(x.y)) each of said predictor motion vectors to determine a respective 
pair of corresponding image blocks in said previous and following image fiekis. respectively; 
c2) for each of said pairs of corresponding image blocks, evaluating an enror function (errp]) which is tiie 
45 Sum of luminance Absolute Difference (SAD) between conresponding image elements in said pair of cor- 

responding image blocks; 

c3) for each pair of said predictor motion vectors, evaluating a degree of homogeneity (H(i,j)); 
c4) for each pair of said predictor motion vectors, applying a fuzzy rule having an activation level (r[k]) 
which is higher the higher the degree of homogeneity of tiie pair of predictor motion vectors and the 
so smallertheerrorfunctionsofthepairof predictor motion vectors; 

c5) determining an optimum fuzzy rule having the highest activation level (r[optD. and determining the best 
predictor motion vector (P[min]) of the pair associated to said optimum fuzzy rule having the smaller error 
function; 

c6) determining tiie estimated motion vector for said image block (K(x.y)) on tiie basis of said best predic- 
ts tor motion vector (P[min]). 

2. Method according to daim 1 . characterized in tiiat said group of neightx>ring image blocks (NB(0]-NB[1]) conprises 
a first sub-group of image btocks (NB[0],NB[1]) prececfing the image block (K(x.y)) in tiie scanning sequence of said 
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sub-plurafity of image blocks, and a second sub<|roup of image bbchs (NB^,NB[3]) foHowing the imagei block tn | 

said scanning sequence. | 

Method according to claim 2, characterized in that said group of neighboring image blocks (NB[0]-NB^]) comprises. I 

the lour image blocks nearest neightx>ring to said image block (K(x.y)) In the diagonal directions. | 

Method according to claim 3. characterized in that said evaluating a degree of homogeneity (HCLj)) comprises com- | 

puting the sum of absolute differences between the components of said palr'^ | 

ak>ng two orthogonal axes (x,y). f 



7. Method according to any one of claims 2 to 6» characterized in that st^ c6) provides for chosing as estimated 
niotion vector tor said image block (K(x,y)) said best predictor motion vector (P^ 

8. Method accorcfing to any one of claims 2 to 6. characterized in that step c) further provides for applying a further 
25 fuzzy rule having an activation level (r[6J) which Is higher the higher the error functiois of the predictor motion vec- 
tors (P[0]-P[3D and the higher the predictor motion vectors (P[0].P[1]) associated to the blocks of said first sub- 
group (NB[p].NB[1]), and determining a candidate estimated motion vector (C) of sak:l image block (K(x,y)) as a 
weighted average between the best predictor motion vector (P[minD and the zero vector, the respective weights 
being the activation fevial MopQ) of said optimum fuzzy rule and the activation level (r[6]) of said furtiier fuzzy rul& 

30 

9. Metiiod according to daim 8, characterized in that sakJ applying a further fuzzy rule comprises determining a first 
value (UP(x)) and a second value (UP(y)) which are ttie sum of the absolute components, respectively along the 
two axes (x«^. of the two predictor motion vectors (P[0].P[1]) associated to said first sub-group of blocks 
(NB[0].NB[1]). determining a second fuzzy set Tiigh" for tiie first and second values, detennining respective 

35 degrees of membership of the first and second values to the second fuzzy set '^high'*, determining a third fuzzy set 
"high" for the values of the en-or functions (entlD, determining respective degrees of membership (e'(i)) of tiie enror. 
function values (errO]) to the third fuzzy set "high". 

1 0. Method according to claim 9, charactaized in that the evaluation of the activation level (r[6]) of tiie further fuzzy rule 
40 comprises determining the minimum among tiie degrees of membership to tiie second fuzzy set "high" of ttie first 

and second values (UP(x),UP(y)) and tiie degrees of membership of the error functions (errliO to tiie tiiird fuzzy set 
niiigh". 

11. Method according to any one of claims 8 to 10. characterized in that step c6) provides tor choosing as estimated 
45 motion vector tor said image block (K(x.y)) said candidate estimated motion vector (C). 

12. Method according to any one of claims 8 to 10. characterized In tiiat step c) further provides for applying to said 
candidate estimated motion vector (C) a set of updates for obtaining a corresponding set of updated rnotion vectors 
(Vlj[1]-Vii[8D and evaluating the enror functions (err) associated to sakl tpdated motion vectors. 

50 

1 3. Method according to daim 1 2, characterized in that tiie updated motion vector having the mininum error function 
is chosen as tiie estimated motion vector for said block (K(x,y)). 

14. Method according to claim 12, characterized in that respective penalty values (PEN1 .PEN2) are added to tiie en-or 
55 functions (err) associated to said updated motion vectors (Vu[1]*VU[8]). tiie penalty values depending on the differ- 
ence in direction between the updated motion vectors and tiie candidate estimated motion vector (C). 

1 5. Metiiod according to any one of the preceding claims, characterized in that said sub-plurality (Q1 .02) of tiie plural- 



Method according to claim 4. characterized in that said apiplying a fuzzy rule comprises det^rfiining a fuzzy set 
"smair tor the values of the error functions, determining a degree of membership of the enor functions (err) to said 
fuzzy set "small", determining a first fuzzy set "high" for tiie values of thei degree of homogeneity, and determinirig 
a degree of rnembeishpd the degree of . honffogener^ | 

Metiiod according to daim 5, characterized in that said activation level (r[k]) of a fuzzy rule cbrtprises determining 
the minimum anriong the degree of membership of the degree of honUDgeneity to the first fuzzy s^ "high" and deter- 
mining tiie degrees of membership of the enor funcb'ons assodated to the predictor motion vectors (P[Q,PDD to 
which th^fuezy rule is applied to the fuzzy set "small". 
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ity of image blocks is made up of image blocks betonging to either one or the other of two complementary quincunx 
patterns. 

16. Method according to claim 15, characterized in that the motion vectors (W) for each image block not belonging to 
5 said sub-plurality of inr^ge blocks (Q1 .Q2) are determined by interpolating the estimated motion vectors (V1*V4) of 

respective neight>oririg blocks belonging to said sutH^lurality. 

17. Method according to daim 16. characterized in that after having determined the estimated motion vector for said 
image block (K{x.y)), the image block (K(x.y)) is further divided into four sub-Wocks, and motion vectors (E.^ +i-E+i.i 

10 i) for each of said sub-blocks are calculated as averages between the estimated motion vector for said image block 
(K(x,y)) and motion vectors (Va-Vd) associated to respective neighboring image blocks. 

18. Method accorcfing to any one of the preceding claims, characterized in that said ievaluating an en-or function (errpD 
tor each of pairs of corresponding Image blocks in the previous and following image fields comprises transforming 

IS the two conresponding image blocks into progressive Ibmriat. 

19. Method according to any one of the preceding claims, characterized by: 

determiningjf a received image field sequence (Oo.Eo,Or) originates from a video camera or from a movie; and 
20 if the received image field sequence originates from a camera, for each pair of received image fields determin- 

ing an interpolated intermediate image field by performing steps a) to d); 

if the received image field sequence originates from a movie, determining an intermediate image field by. per- 
forming steps a) to d) only for altemate pairs of received image f iekis, said alternate pair of f iekfs comprising 
two fields belonging to different image frames. 

25 

20. Method according to claim 19. characterized in that said determining if tiie received image fiekl sequence origi- 
nates from a video camera or from a movie provkies for: 

for each current received iniage fiekl. evaluating a cunrent accumulated value (Ac) of tiie estimated motion vec- 
tors describing movement of tiie image btocks between a previous received image field and said cun-ent 
received image field; 

evaluating a cun-ent ratio (|Ac/Ap|) between tine current accumulated value (Ac) and a previous accumulated 
value (Ap) of tfie estimated motion vectors describing movertient of the image blocks between a further previ- 
ous received image field and sakj previous received image field; 

determining if said received field sequence originates from a movie on the basis of the value of said cunrent 
ratio, the value of a previous ratio associated to tiie tiiree previous received image fields preceding said current 
received Image field, and a parity of the current received image field. 

21. Device suitable for actuating the method according to any one of the preceding claims, characterized by oompris- 
40 ing: 

-) image element storage means (BUF1 .BUF2) for storing image elements of ttie previous and following image 
f iekiis for creating a search area in the previous and following image fields; 
-) addressing means (ADDQEN) for addressing selected image elements in said storage means; 
-) motion vector storage means (VMEM) for storing the estimated motion vectors; . 

-) first computation means (SAD1) supplied by said storage means for evaluating said enror functions (enr[i]) 
associated to said predictor motion vectors (P[i]); 

-) a fuzzy conrputation unit (FUZZY) supplied by said first confutation means and said motionvector storage 
means for determining said best predictor motion vector (P[min]) by applying said fuzzy rule to each pair of pre- 
dictor motion vectors (P[i]) and to the values of the associated enror functions; 

-) interpolation means (INT) supplied by said storage means for determining ^ch in^ge element of said image 
block (K(x,y)) by interpolation of two corresponding image elements in said previous and following image fields 
related by said estimated motion vector. 

55 22. Device according to claim 21 . characterized in that sakf fuzzy computation unit (FUZZY) comprises an homogene- 
ity evaluator (HE) for evaluating the degree of homogeneity (H(i.j)) of each pair of tine predictor motion vectors (Pp]). 
a first rnembership evaluator (Ml) stf^lied by said degree of homogeneity for determining a degree of membership 
of the degree of homogeneity to a first fuzzy set "high", a second membership evaluator (M2) supplied by said error 
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furictions (errtO) for determinu^^ | 

computation unrt(RCI) supplied by the fii^ and sec^ | 

(rjl^ of said fuzzy rules, a rule selector (RS) supplied by the first rule computation unit for determining the fuzzy | 

rule having the highest activation level (r[opq), and a vector selector (VS) supplied by the rule selector and the pre- f 

5 didbr motion vectors (P[iD for determinlrig said best pr 'I 

23. Device according to daim 22, characterized in that said fuzzy computation unit (FUZZY) further conrprises a third I 
men*ershlpevaIuatbr(M3)suppfied with said en-or function yalu^ | 
of the error function valu^ to a second fuzzy set "high", an^ension evaluator (EE) supplied with the predictor | 

10 motion vectors (P[min]) for determining a first value (UP(x)) and a second value (UP(y)) i^^oviding a measure of I 

extension of tiie predictor motion vectors respectively along two coordinate axes (Xpy). a fourth menrtoership evalu- . I 

ator (M4)fc»' determining a degree of menr6ership of the first and second valuer 1 

ond rule computation unit (RC2) supplied by the third and fourth membershp evaluators (M3,M4) for determining | 

the activation lev^ of a furtiier fuzzy rule, a rule composition unit (RC) supplied t>y the rule selector (RS), the vector ^ 

IS selector (VS) and the second rule computation unit (RC2) for detemhinihg said candidate estimated motion vector i 

(C). I 

24. Device according to daim 23, characterized by comprising a vector iqxiating block (CBUILD) supplied by the fuzzy | 
computation unit (FUZZY) for applying to the candidate estimated motion vector (C) a set of updates for obtaining | 

20 updated motion vectors (VIj[1]-VIj[8D. second confutation means (SAD2) fbr evaluating eh^or fundions assodated f 

to said updated motion vectors, and a candidate selector (CSEL) sipplied by said second computation unit fbr 1 

determining the updated nKTtion vector having the minimum assodated error function. 1 

25- Device according to daim 24, characterized in that said vector updating block (CBUILD) comprises a vector com- I 
25 ponent splitter (SP) fbr determining the components (Cx.Cy) along said coordinate axes (x.y) of said candidate esti- 
mated motion vedor (C). a first and a second adders (ADD1 ,ADD2) for respectively adding to each component of 
the candidate estimated motion vector a respective update value, and a vector component merger (MC) for merg- 
ing together saki components. 

30 26. Device according to any one of daims 21 to 25, characterized by comprising detedor means (FMDET) fbr detecting 
if a received image fiekJ sequence (Oo.Eo.Oi) originates from a vkieo camera or from a movie. 

27. Device according to daim 26, charaderized in tiiat sakJ detector means (FMDET) comprises a vector accumulation 
means (VACC) fbr cateulating a current accumulated value (Ac) of the estimated motion vectors describing move- 
rs ment of the image blocks between a previous received image field and a cun^ent received in^ge field; a first register 
(DELAY) fbr storing a previous accumulated value (Ap) of the estimated motion vectors descn*bing movement of the 
image blocks between a further previous received image field and said previous received image field: a divider 
means (Dl V) for evaluating a current ratio (|Ac/Ap|) between the cunrent accumulated value (Ac) and the previous 

accumulated value (Ap); a second register (R) for storing tiie value of a previous ratio associated to tiie three pre- j 

40 vious received image fields preceding said cunrent received image field, and means (CMRLG) fbr determining if % 

said received field sequence originates from a movie on the basis of the value of said current /atio, the value olF said ). 

previous ratio and a parity of the cunrent received image field. I 

• V 
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